arXiv: 1505.01133vl [cs.IT] 5 May 2015 


1 


Outer Bounds on the Admissible Source 
Region for Broadcast Channels with Correlated 

Sources 


Kia Khezeli and Jun Chen 


Abstract 


Two outer bounds on the admissible source region for broadcast channels with correlated sources are presented: 
the first one is strictly tighter than the existing outer bound by Gohari and Anantharam while the second one provides 
a complete characterization of the admissible source region in the case where the two sources are conditionally 
independent given the common part. These outer bounds are deduced from the general necessary conditions established 
for the lossy source broadcast problem via suitable comparisons between the virtual broadcast channel (induced by 
the source and the reconstructions) and the physical broadcast channel. 


Index Terms 


Bandwidth mismatch, broadcast channel, capacity region, deterministic channel, joint source-channel coding. 


I. Introduction 


Let {S'(f)}“ be an i.i.d. random process with marginal distribution ps over alphabet S. In the lossy source broad¬ 
cast problem (see Fig.[T]i, an encoding function 5™ —)• maps a source block S"" 4 (5(1)^... ^ S{m)) 

to a channel input block = (J'f(l),--- ,X{pm)), which is sent over a discrete memory less broadcast 

channel PYi,Y 2 \x with input alphabet X and output alphabets i = 1,2; at receiver i, a decoding function 


^{pm,m) . ypm j-jjg channel output block • • • , Yi{pm)) (generated by X'’™) to a source 

reconstruction block = ((Si(l), • • • , Si{m)), i = 1,2. The number of channel uses per source sample, i.e., p, is 


referred to as the bandwidth expansion ratio. We assume that S, Si, S 2 , X, ^ 1 , and 3^2 are finite sets throughout 
the paper. 


Definition 1: Let Wi : S x Si ^ [0, c»), i = 1,2, be two distortion measures. We say distortion pair {di, ^ 2 ) is 
achievable under distortion measures wi and W 2 subject to bandwidth expansion constraint k if, for every e > 0, 
there exist encoding function : S"^ —>■ XP"^ and decoding functions ; yP'^ S^, i = 1,2, with 

p < K + e, such that 
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Fig. 1. The lossy broadcast problem 



Fig. 2. Broadcasting correlated sources 


A special case of the lossy source broadcast problem, sometimes referred to as broadcasting correlated sources (see 
Fig.m, has received particular attention. In this case, S{t) = {Si{t), S 2 {t)) with S'i(f) and S 2 {t) jointly distributed 
according to P(Si,S 2 ) alphabet 5i x S 2 , t = 1,2, ■ ■ ■, and receiver i wishes to reconstruct almost 

losslessly, i = 1,2. 

Definition 2: A source distribution P(Si^S 2 ) ^aid to be admissible for broadcast channel Pyi,Y 2 \x subject to 
bandwidth expansion constraint k if, for every e > 0, there exist encoding function : 5™ x 5™ —)• A’" and 

decoding functions S™, i = 1,2, with p < k + e, such that 

.. m 

-y^PT{Sfit)^Sfit))<e, i = l,2. 

The set of all such P(Si,S 2 ) referred to as the admissible source region for broadcast channel Pyi,Y 2 \x subject to 
bandwidth expansion constraint k. 

Remark; Dehnition |2] is a special case of Definition [T] with di = c ?2 = 0 and Wi : S x Si ^ {0,1} given by 




0 , Si — Si 


i = 1,2. 


( 1 ) 


I 1, otherwise 

It is worth mentioning that, for the problem of broadcasting correlated sources, typically the more restrictive block 
error probability constraints are adopted. However, it is clear that outer bounds derived under average symbol error 
probability constraints automatically hold under block error probability constraints. 
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Han and Costa m derived an inner bound on the admissible source region; see El for a minor correction and 
El for an alternative characterization. Outer bounds were established by Gohari and Anantharam and by Kramer, 
Liang, and Shamai. Note that, due to the lack of cardinality bounds on the auxiliary random variables, neither the 
original version of the Gohari-Anantharam outer bound a, El nor the Kramer-Liang-Shamai outer bound a is 
directly computable. Thanks to El, a computable characterization of the Gohari-Anantharam outer bound has been 
found recently El, Q. On the other hand, it is difficult, if not impossible, to express the Kramer-Liang-Shamai 
outer bound in a computable form because of the fact that certain auxiliary random variables involved in this bound 
are constrainecQ to be i.i.d. copies of the source variables. For this reason, only the Gohari-Anantharam outer bound 
is considered in the present work. 

In this paper we establish two necessary conditions for the lossy source broadcast problem. Both conditions 
are built upon the intuition that the virtual broadcast channel (induced by the source and the reconstructions) is 
dominated by the physical broadcast channel. Our effort is largely devoted to seeking mathematical formulations 
that can capture, to a certain extent, this vague intuition. It will be seen that the notion of dominance, which has a 
precise dehnition in the point-to-point case due to the source-channel separation theorem, permits several possible 
generalizations to the broadcast channel setting, and each generalization gives rise to a necessary condition for 
the lossy source broadcast problem. These necessary conditions, when specialized to the problem of broadcasting 
correlated sources, yield two outer bounds on the admissible source region; the first one is strictly tighter than 
the Gohari-Anantharam outer bound while the second one provides a complete characterization of the admissible 
source region in the case where the two sources are conditionally independent given the common part. 

The rest of this paper is organized as follows. We explain our general approach in Section|II] Section Hill contains 
a short review of the relevant capacity results for broadcast channels. The necessary conditions for the lossy source 
broadcast problem and the induced outer bounds on the source admissible region are presented in Sections HVl and 
[Vl We conclude the paper in Section |Vl] 

IT Virtual Channel versus Physical Channel 

For the purpose of illustrating our general approach, it is instructive to hrst consider the point-to-point com¬ 
munication problem. Specihcally, in the point-to-point setting, an encoding function : S™ A’'’™ maps 

a source block S'™ to a channel input block X'’™, which is sent over a discrete memoryless channel py\x with 
input alphabet X and output alphabet y\ at the receiver end, a decoding function -x S™ maps the 

channel output block (generated by X'’™) to a source reconstruction block S™. For any conditional distribution 
let pg|g be its single-letterized version dehned as 

^ m 

*If such a constraint is removed, then the Gohari-Anantharam outer bound is at least as tight as the Kramer-Liang-Shamai outer bound. 
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where 

Ps{t)\s{t)is\s) = n Ps(-<t'))- 

s'^:s{t)—s 

:s{t)—s 

One can readily verify that 

- m 

E[r/;(5, 5)] = - V E[w{S{t), 5(f))] (2) 

for any distortion measure u> : 5 x 5 —>■ [0, oo). We say that is degraded with respect to pypm|xpm (where 

PYprr.\xprr.(:yP'^\xP'^) = Y{qZi Py\X{ v{q)\x(,q))) if 

Psr.\srr^{s^\n = E Px.™ | I I )Ps™ l yp™ 12/"™) 

j>pm ypm 

for some conditional distributions pxf‘'^\S"‘ Pgmiypm; note that, in the point-to-point communication problem, 
we have 

Px.m\sm{xP'^\s'^) = 

Ps^^y,^{sny^n = = g^"Hyn), 

where I(-) is the indicator function. We shall refer to an arbitrary conditional distribution pg^g as a virtual channel, 
and say that it is realizable through the physical channelpyjx with bandwidth expansion ratio p if it can be obtained, 
via single-letterization, from certain Pgm^gm degradeq^ with respect to pYP<n\xp^- It is worth emphasizing that a 
realizable pg^g is not necessarily degraded with respect to Py\x- Indeed, even in the bandwidth-matched case (i.e., 
p = 1), there might not exist conditional distributions px\s ^itd Ps|y such that 

Ps|s(sN) = J2P^\si^\^)PY\x{y\x)Ps\Yis\y) 

X,y 

since otherwise the end-to-end distortion ^ E[r(;(5(f), 5(f))] could be achievecj^ without coding. Nevertheless, 

it can be shown that every realizable pg^g is dominated by py|x in the sense that 

I{S-S)<pI{X-Y) (3) 

for some input distribution px- In a certain sense, Q is the only connection between a generic realizable virtual 
channel and the physical channel. Indeed, the source-channel separation theorem essentially asserts that a virtual 
channel pg^g is (asymptotically) realizable through the physical channel py|jr with bandwidth expansion ratio p 
if and only if pg^g is dominated by py\x in the sense of 0. Note that, given bandwidth expansion ratio p, the 
achievability of end-to-end distortion d is equivalent to the existence of a realizable virtual channel satisfying 

^Since Pgm^gm is only required to be degraded with respect to pYpm^xp'f^ ^ we essentially allow non-deterministic encoding and decoding 
functions. However, it can be shown via a standard derandomization argument that restricting encoding and decoding functions to deterministic 
ones does not affect the set of (asymptotically) realizable virtual channels. 

^One could simply use source variable S to generate channel input X via px\S^ '^se channel output Y to generate reconstruction variable 
S via pgyY' Iri light of the resulting distortion E[m(S', §)] is the same as ^ 5(f))]. 
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E[?ii(S', 5)] < d. More generally, one can formulate the question of determining whether there exists a realizable 
virtual channel in a prescribed set; imposing distortion constraints can be viewed as a specific way of choosing 
such sets. 

This perspective can also be adopted in the broadcast channel setting. For any conditional distribution pgm gmigm, 
we define its single-letterized version pg^ as 

^ m 
t=l 


where 


^’Si(t),S2(t)|S(t)(®l’'®2k) — ^ ’ ®2 |s ) Psisit)). 


■.s{t)—s 

s'^:si{t)=si, i— 1,2 


It can be verified that 


. m 


for any distortion measure Wi : S x S ^ [0, oo), z = 1,2. We say that degraded with respect to 

(where = nglTiP f|x(2/i(9), 2 / 2 (<?)|a;(g))) if 

2 

Psr,sT\s-i^T,sT\sn= E px>--\sA^nsnPYr,yr\x^-iyr,yr\^^nUpsr\Yr^^^^^^ 

XPm^yP^ yP’^ i=l 

(4) 


for some conditional distributions pxp^is™ ^nd Pgmjypm, i = 1, 2; note that 

PXPm\Sm{xP"^\s'^) = = /(™.P'")(s'")), 

PsrwM^Tlyn = = 9‘f^'^\yr)\ * = 1 , 2 , 


in the lossy source broadcast problem. We shall refer to an arbitrary conditional distribution pg^ as a virtual 
broadcast channel, and say that it is realizable through the physical broadcast channel with bandwidth 

expansion ratio p if it can be obtained, via single-letterization, from certain pg^ S”*|S™ degraded with respect to 
pyp™ ypm|xpm. The fundamental problem here is to determine whether there exists a realizable virtual broadcast 
channel satisfying the distortion constraints (or more generally, whether there exists a realizable virtual broadcast 
channel in a prescribed set). It is conceivable that every realizable virtual broadcast channel must be dominated, 
in a certain sense, by the physical broadcast channel. However, it is apparently a formidable task to develop a 
computable notion of dominance that can completely characterize the set of realizable virtual broadcast channels 
(since that would solve several long-standing open problems in network information theory). Nevertheless, if one 
does not insist on such a complete characterization, then it is indeed possible to establish certain connections 
between a generic realizable virtual broadcast channel and the physical broadcast channel by suitably generalizing 


4 


It is worth mentioning that the idea of viewing the conditional distribution of the reconstructions given the source as a virtual broadcast 


channel was exploited earlier in Qo), [m through a different angle. 
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Mq, Ml, M2 



Moi, Ml 


Mo2, M 2 


Fig. 3. Broadcast channel with common and private messages 


For example, it is straightforward to show that, if is realizable through Pyi,Y2\x with bandwidth expansion 
ratio p, then must be dominated by Pyi,Y2\x in the sense that 

I{S-Si)<pI{X-Yi), i = l,2, 

for some input distribution px- This is by no means the only possible generalization of Q to the broadcast channel 
setting, and two stronger notions of dominance will be presented in Sections |IV] and |Vl Note that each notion of 
dominance implicitly provides an outer bound on the set of realizable virtual broadcast channels, which in turn 
yields a necessary condition for the achievability of any given distortion pair. 

III. Review oe Capacity Results eor Broadcast Channels 

We shall give a brief review of certain capacity results for broadcast channels that are relevant to the notions of 
dominance developed in Sections HVl and IVl Let Pyi,Y2\x be a discrete memoryless broadcast channel with input 
alphabet X and output alphabets Vu i = 1,2. A length-n coding scheme (see Fig. O for Pyi,Y 2 \x consists of 
■ a common message Mq and two private messages Mi, i = 1,2, where {Mq, Mi, M 2 ) is uniformly distributed 
over Mo x Mi x M 2 , 

• an encoding function : Mq x Mi x M 2 -T” that maps {Mq,Mi,M 2 ) to a channel input block X”, 

(n) (n) 

m two decoding functions g) : yp —?■ Mo x Mi, i = 1,2, where g) maps the channel output block at receiver 
i, i.e., Yjpi, to {Moi,Mi), z = 1,2. 

Definition 3: A rate triple {Ro, Ri, R2) S is said to be achievable for broadcast channel Pyi,Y2\x if there 
exists a sequence of encoding functions : Mo x Mi x M2 -T" with Mog\Mi\ > Ri, i = 0,1,2, and 

in) 

decoding functions g\ : V" Mo x Mi, i = 1,2, such that 

lim Pr{(Moi,Mi) ^ (Mo, Ml) or (Mo 2 ,M 2 ) (Mo, M 2 )} = 0. 

n—voo 

The capacity region is the closure of the set of all achievable {Rp),Ri^R 2 ) for broadcast channel 

Py^,Y 2 \x- 


May 6, 2015 


DRAFT 












7 


Let Cm{px,PYi,Y 2 \x) denote the set of (i?o,^^ 2 ) S R+ satisfying 
i?o <niin{/(Lo;yi),/(Lo;i" 2 )}, 

Rq + i?i < I(Vo, Vi] Yi), i = 1, 2, 

i?o + i?i +i ?2 < uim{IiVo]Y,),IiVo]Y2)} + nVi]Y,\Vo) + IiV2]Y2\Vo) - IiVuV2\Vo) 

for some PVo,Vi,V 2 ,x,YiY 2 = PVo,Vi,V 2 \xPxPyi,Y 2 \x- Here it suffices to consider |Vo| < \X\ + A and \Vi\ < \X\, 
i = 1,2] moreover, there is no loss of generality in assuming that X is a deterministic function of {Vq, Li, V 2 ) ifTTl 
Theorem ij^ Define 

Cm{PYi,Y2\x) = y_}Cm{PX,PYi,Y2\x)- 

px 

We have lfT5l Theorem 1] IfT^ p. 391, Problem 10(c)] 

C\n{PYi,Y2\x) Q C{pyi,Y2\x)- 

Note that C\n{pY^^ y 2 \x) is widely known as Marton’s inner bound (see ifTTI Theorem 2] for the case Rq = 0). 

Let Cou{{pxtPYi,Y 2 \x) denote the set of {Rq, Ri, R 2 ) G satisfying 

i?o <min{/(Lo;Li),/(Lo;y2)}, 

+ <min{/(Lo;Li),/(Lo;y2)} + /(L;L|Lo), * = 1,2, 

i?o + i?i + i?2 < min{/(Lo; Fi), I{Vo] Y2)} + /(L; Fi|Lo) + I{X] F2IL0, L), 

i?o + + i?2 < mm{/(Lo; L), /(Lq; F2)} + /(L; F2 1 L)) + /(X; Fi |Lq, L2) 

for some Pyn,Vi,V 2 ,x,Yi,Y 2 = PVq,Vi,V 2 \xPxPy 2 ,Y 2 \x- Here it suffices to consider |Vo| < |<T| + 5 and |L| < \X\ + 1, 
* = 1,2 m Define 

Coul{pYi,Y2\x) = \^Coq\{px,PYi,Y2\x)- 
px 

We have fTll 

C{pyi,Y2\x) VCoqx{py,^,Y2\x)- (5) 

It is worth noting ES, M that Cm{px,PYx,Y 2 \x) can be defined equivalently as the set of {Rq,Ri,R 2 ) G 
satisfying 

i?o <niin{/(Lo;Fi),/(Lo;r2)}, 

+ <min{J(Lo;Fi),/(Lo;r2)} + /(L;L|Lo), * = 1,2, 

i?o + i?i +i?2 < min{/(Lo;Fi),/(Lo;y2)} + /(Li;ri|Lo) +/(L2;F2 |Lo) -/(Li;L2|Lo) 

^It is expected (B] that one can further improve the cardinality bounds on Vj, 2 = 1, 2, to |Vi| + |V 2 | < |A:’| + 1 by leveraging the techniques 
developed in ca. 

^In fact, the cai'dinality bounds on Vi, 2 = 1,2, can be further improved to |Vi| < 2 = 1,2 Gl 


May 6, 2015 


DRAFT 


for some PVo,Vi,V2,x,y^,Y2 = PVo,Vi,V2\xPxPyi,Y2\x- With this equivalent definition of Cin{px,PYi,Y2\x), one can 
readily show 


Cin{PX,PY^,Y2\x) C Cout iPX,PYi,Y2\x) 


by invoking the fact that, for any PVo,Vi,V2,x,Yi,Y2 = PVo,Vi,V2\xPxPyi,Y2\x, 


I{X-,Y2\Vo,Vi) > I{V2;Y2\Vo,Vi) 


= I{V2;Y2,Vi\Vo) - I{Vp,V2\Vo) 


> I{V2;Y2\Vo) - I{Vy,V2\Vo) 


and similarly 


I{X-,Yi\Vo,V 2) > IiVY,Y,\Vo) - I{Vi;V2\Vo). 


IV. Approach I: Comparison of Certain Measurements Induced by Test Distributions 
A. The Lossy Source Broadcast Problem 

As explained in Section|nl our goal is to develop suitable notions of dominance that can (partially) characterize the 
set of realizable virtual broadcast channels. One such notion is established in the following Lemma (with its proof 
relegated to Appendix lAli. Roughly speaking, it shows that every realizable virtual broadcast channel pg^ (with 
input distribution ps) is dominated by the physical broadcast channel Pyi,Y 2 \x (with certain input distribution px) 
in the sense that, given any test distribution Pug,- - ,Ul\S for Pg^ .S 2 IS’ ^ corresponding test distribution 

PVo,--- ,Vl\x for such that certain measurements based on Puo,--- ,Ul\sPsPs-^^ are less than or equal to 

those based on Pvg, -- ,Vl\xPxPYi,Y 2 \x multiplied by bandwidth expansion ratio p. 

Lemma 1: If a virtual broadcast channel pg^ is realizable through the physical broadcast channel Pyi,Y 2 \x 
with bandwidth expansion ratio p, then there exists an input distribution px such that, for any p^j^ Ul S Si S 2 ~ 
PUo,-,UL\sPsPg^^g^\g, one can find PVo, - ,Vl,x,Yi,Y 2 = PVo,- ,Vl\xPxPyi,Y 2 \x satisfyinj] 

k k 

i=l ■’ i=l 

for any C {0, • • ■ , L} and a{i) C {1, 2}, i = 1, • • • , k. 

The following result, which gives a general necessary condition for the lossy source broadcast problem, is a 
simple consequence of Lemma [T] Its proof can be found in Appendix IbI 

Theorem 1: If distortion pair {di,d 2 ) is achievable under distortion measures rui and W 2 subject to bandwidth 
expansion constraint k, then there exists a virtual broadcast channel with E[wi(S', 5^)] < i = 1, 2, and an 

^Here L and k are arbitrary positive integers. We define Ux = (Ui)i^x when A is a non-empty subset of {0, ■ ■ ■ , L} and define Ux = 0 
Otherwise; is defined analogously. 
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input distribution px such that, for any Puo,Ui,U 2 ,S, 81,82 = PUo,Ui,U 2 \ 8 P 8 Psi,S 2 \ 8 ^ PVo,Vi,V 2 ,x,Yi,Y 2 = 

PVo,Vi,V 2 \xPxPyi,Y 2 \x satisfying 

HUo;Si)<KliVo;Yi), i = l,2, 

IiUo,UfJi) < Kl{Vo,Vf,Yi), i = l, 2 , 

I{Uo\ Si) + /(C/ 2 ; *52|C7o) < k[/(Vo; Yi) + /(V 2 ; 1211^)]; 

/(C/o;^ 2 ) + I{Ui-Si\Uii) < k[I{Vo-Y^) + I{Vi-,Yi\Vo)], 

IiUo,Ui;Si) + I{S-S 2 \Uo,Ui)<K[I(yo,Vi-,Yi)+IiX-,Y 2 \Vo,Vi)l 
/(C/o, C/ 2 ; 52 ) + I{S; Si\Uo, C/ 2 ) < K[I(yo, 1 ^ 2 ; Y 2 ) + I{X- Yi\Vo,V 2 )], 

/(C/o; ^ 1 ) + /(C/ 2 ; ^ 2 |C/o) + nS; Si\Uo, C/ 2 ) < k[I{Vo; Yi) + /(Y 2 ; Y 2 IY 0 ) + I{X; Yi\Vo, Y 2 )], 

/(C/o; ,52) + /(C/i; I C/o) + /(5; 521 C/o, C/i) < K [/(Yo; Y 2 ) + /(Yi; Yi I Yo) + /(//; Y 2 1 Yo, Yi)]. 

Here it suffices to consider \Uq\ < |5|, |Vo| < \X\ + 5, \Ui\ < |5|, and \Vi\ < \X\, i = 1,2. 

Remark: Gohari and Anantharam independently obtained a necessary condition for the lossy source broadcast 
channel |l8l Theorem 2], which is, roughly speaking, a special case of Theorem [T] with k = 1, S = (5i,52), and 
Ui = S„i = 1,2. 

The following result is a direct consequence of Theorem [T] 

Corollary 1: If distortion pair (di, 1 / 2 ) is achievable under distortion measures rui and W 2 subject to bandwidth 
expansion constraint k, then there exists a virtual broadcast channel pg^ with E[r(;i(5, 5^)] < di, i = 1,2 and 
an input distribution px such that 

Cout(/'S,Psi,S2|s) - ^^oui{PX,PYi,Y 2 \x)- 

B. An Improved Outer Bound on the Source Admissible Region 

The following outer bound on the admissible source region was established by Gohari and Anantharam ||8] 
Corollary 2] (see also ||9] Theorem 2]). 

Let Sq denote the common part between Si and S 2 in the sense of mi, Eo). 

Theorem 2: If P{ 8 i, 82 ) admissible for broadcast channel Pyi,Y 2 \x subject to bandwidth expansion constraint 
K, then there exists PVo,VuV 2 ,x,Yi,Y 2 = PVo,Vi,V 2 \xPxPYi,Y 2 \x such that 

H{So) < Acmin{/(Yo; Yi),/(Yo;Y 2 )}, 

//(5,) <K[min{/(Yo;Yi),/(Yo;Y 2 )} + /(Y;Y|Yo)], ^ = l,2, 

//(5i, 52 ) </c[min{/( Yo; Yi),/(Yo; Y 2 )} +/(Yi; Yi I Yo) +/(X; Y 2 1 Yo, Yi)], 
i/(5i, 52 ) < /c[min{/( Yo; Yi), /( Yq ; Y 2 )} + /(Y 2 ; Y 2 1 Yq) + /(X; Yi | Yq, Y 2 )]. 

It is easy to observe that the inequalities in the statement of Theorem |2] closely resemble those in the definition 
of Cout(pyi,Y' 2 |x)- In fact, one can readily establish Theorem 2 by interpreting So as the common message and 
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Si as the message (including both the private message Mi and the common message Mq) intended for receiver 
i = 1 , 2 , and then following the proof of (| 5 ]l. However, this approach is not completely satisfactory. Note that 
Mq, Ml, and M 2 are assumed to be independent. If the correspondence between sources and messages is exact, 
then Si Sq S2 must form a Markov chain. That is to say, the source-message correspondence does not fully 
capture the dependence structure between and S'2. 

We shall show that one can obtain a tighter outer bound on the admissible source region by specializing Theorem 
[T]to the case of broadcasting correlated sources. Note that, if J 2 s Ps(s)PSi|s(si |s)tUi(s, s^) = 0 for Wi given by 
O, i = 1,2, then we must havj^p^^ = PSi,S2\{Si,S2)^ which is a deterministic broadcast channel; moreover, 
in this case, there is no loss of optimality in choosing Ui = Si, i = 1 , 2 . As a consequence, we obtain the following 
outer bound on the admissible source region. 

Theorem 3 : If P(Si,S2) admissible for broadcast channel PYi,Y2\x subject to bandwidth expansion constraint 
K, then there exists an input distribution px such that, for any Pu,{Si,S2) = Pu\{Si,S2)P{Si,S2)’ 011® 
PVo,Vi,V2,x.Yi,Y2 = PVo,Vi,V2\xPxPYi,Y2\x satisfying 

IiU-,S,)<Kl{Vo-,Y,), i = l,2, 

H{Si)<Kl{VQ,VY,Yi), i = l,2, 

I{U-, Si) + H{S2\U) < k[I{Vq-, Yi) + I{V2-, r2|Vj))], 

I{U-, S2) + H{Si\U) < k[I{Vq-, Y2) + I{Vi,Yi\Vq)], 

I{U-Si) + H[Si,S2 \U) < t^[I{VQ,Vi,Yi) + I{X-Y2 \Vq,Vi)], 

I{U-, S2) + H{Si,S2\U) < k[I{Vq,V2-,Y2) + /(X; Yi\Vo, ^2)], 

IiU-,Si) + H{Si,S2\U) < K[I(yo-,Yi) + I{V2;Y2 \Vo) + I{X-,Yi\Vo,V2)], 

/([/; S2) + H{Si,S2 \U) < KinVo; Y2) + I{Vi-,Yi\Vo) + /(X; 1 ^ 21 ^ 0 , 

Here it suffices to consider \IA\ < | 5 i| x | 52 |, |Vo| < \X\ + 5 , and \Vi\ < \X\, i = 1,2. 

It is easy to verify that 

Cin(P(Si,S2),PSi,S2|(Si.S2)) = Cout(P(Si.S2)jPSi.S2|(Si.S2)) = C{p(Si,S2))^ (6) 

where C(p(Si,S2)) denotes the set of {Rq, Ri, R2) € satisfying 

Rq < min{/(f/; Si),I{U-, 52)}, 

Rii+R^<mm{I{U;Si),I{U-,S2)} + H{S^\U), i = l, 2 , 

Ro+Ri+R2< min{/(C/; Si), I{U; 52)} + H{Si,S2\U) 

for some Pu,{81,82) = Pu\{8i,S2)P{8i,S2) "'dh \U\ < |iSi| x | 52 | + 2 . One can deduce the following result from 
Theorem [3 (or Corollary [T])- 


^More precisely, we have S2I5 


>'52K^i>52) input alphabet restricted to {s € 5 : Ps{^) > 0 }- 
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Corollary 2: If P(^Si,S 2 ) admissible for broadcast channel Pyi,Y 2 \x subject to bandwidth expansion constraint 
K, then there exists an input distribution px such that 

^(.P{Si,S2)) ^ fiCout{PX,PYi,Y2\x)- (7) 

The necessary condition in Theorem |2] can be written compactly as 

{H{So),H{Si\So),H{S2\So)) G KCout{pYi,Y2\x) (8) 

when Si So <rY S 2 form a Markov chain. The following result shows that the same simplification is possible for 

Theorem [3 and, as a consequence, these two theorems are equivalent in this special case. 

Theorem 4: The necessary condition in Theorem |3 is equivalent to (l8]l when Si So S 2 form a Markov 
chain. 

Proof: See Appendix O ■ 

It is clear that one can recover Theorem |2] from Theorem |3] by choosing U = Sq- Therefore, the new outer 
bound is at least as tight as the Gohari-Anantharam outer bound. We shall give an example to show that the 
improvement can be strict. Our example is motivated by the observation that the characterization of the capacity 
region of the deterministic broadcast channel with a common message involves an auxiliary random variable which 
is not necessarily a function of the channel input II 2 TII as well as the observation that H{So) is not a continuous 
function of P(Si,S 2 )- 

Now consider the example where the physical broadcast channel is the Blackwell channel py^ Y 2 \X’ where 

Pn,Y2\xiyi^y2\x) 

^ f 1 , (x,t/i,y 2 ) = (0,0,0),(1,1,1),(2,0,1) 

I 0 , otherwise 

with X G {0,1,2} and yi G {0,1}, i = 1,2; moreover, let = (5'o(a),.§i) and S 2 = (5o(a),;52) with a G 
log2 3 — |), Tf^^(log2 3 — |)), where .So(a), So{ci), Si, and S2 are binary random variables defined over 
{0,1}, and : [0,1] —>• [0,^] is the inverse of the binary entropy function H^f). Specifically, we assume 

that (,So(a), S'o(ct)), <§1, and S2 are mutually independent with 

Psi(O) =PS2(0) = 

PSo(a)(0) =PSo(c)(0) = a, 

PSo(a)|So(a)(l|0) = PSo(a)|So(a) 1^) = 

q;^(q;) 

PSo(a)|So(a)(*^|l) = PSo(a)|So(a)(0|l) = 1 “ j ^ > 
where /3(a) is the unique solution in (0,1 — a] of the following equation 

H{So{a),So{a)) = log2 3 - 
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Note that such S*! and S2 have no non-trivial common part, i.e., H{So) = 0 . By setting px( 0 ) = px(l) = 
px(2) = |, Vo = 0, and Vi = Yi, i = 1,2, one can readily verify that P(Si,S2) satisfies the necessary condition 
in Theorem | 2 ] with k = 1 for any a € log2 3 — |), iT^^(log2 3 — |))- However, we shall show that 

this is not the case for Theorem [3 It is easy to see that, if the afore-described P(Si,S2) admissible for the 
Blackwell channel y^\x subject to bandwidth expansion constraint k, then, by Corollary | 2 ] as well as the fact 
that CouiiPy.x^ix) = ^(Pyi,Y2\x)’ we must have 

C(p(Si,S2)) S '^^(Pyi,Y2\x)- ( 9 ) 

By choosing U = ( 5 o(a), .So(a)), one can readily verify that {Hb{a), |) is contained in C{p(^Si,S2)) 

a S log2 3 — |), Tf^^(log2 3 — |)). On the other hand, it follows from || 2 ] Lemma 1 ] that (log2 3 — 

is not contained in C(pP^ Y2\x)- Note that {Hbia), |) converges to (log2 3 — as a 7T^^(log2 3 — |). 

Since C{py^;y2\x) is closed, it follows that P(Si,S2) violates (j^l with k = 1 (and consequently the necessary 
condition in Theorem [ 3 with k = 1 ) when a is sufficiently close to iJjj”^(log2 3 — |). 

This example indicates that choosing U = So in Theorem [3 is not always optimal. In this sense, the common 
part between Si and S2 does not play a fundamental role in the new outer bound; see |I3 for a related observation. 

V. Approach II: Comparison of Capacity Regions 
A. The Lossy Source Broadcast Problem 

In a certain sense, the notion of dominance in Section |IV] hinges upon the converse results for broadcast channels. 
In this section we shall develop a different notion of dominance that is mainly based on the achievability results 
for broadcast channels. This notion is captured by the following lemma, which shows that every realizable virtual 
broadcast channel pg^ is dominated by the physical broadcast channel PYi,Y2\x in the sense that Marton’s 
inner bound of pg^ with input distribution ps is contained in the capacity region of PYi,Y2\x- The proof of 

this lemma is relegated to Appendix iDl 

Lemma 2 : If a virtual broadcast channel pg^ is realizable through the physical broadcast channel Pyi,Y2\x 
with bandwidth expansion ratio p, then 

Cin(pSjPsj^ 52 | 5 ) ^ pCiPYi,Y2\x)- 

The following necessary condition for the lossy source broadcast problem is a simple consequence of Lemma |3 

Theorem 5 : If distortion pair {di,d2) is achievable under distortion measures rui and W2 subject to bandwidth 
expansion constraint k, then there exists a virtual broadcast channel pg^ with E[wi(S', 5 i)] < di, i = I, 2 , such 
that 

Cin(PS,P5^,S,|5) C kC{py^^Y2 \x)- 

Proof: Let {di,d2) be a distortion pair that is achievable under distortion measures wi and W2 subject to 
bandwidth expansion constraint k. In view of Definition [3 and the discussion in Section m for every e > 0, 
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there exists a virtual broadcast channel realizable through the physical broadcast channel Pyi,Y 2 \x with 

bandwidth expansion ratio p < k + e such that £[^^(5', + e, i = 1, 2. It follows from Lemma |2] that, for 

such pg(e) g(e)|g, we have 

Cin(pS,P5W_5(«)|5) C {k + e)C{pYi^Y2\x)- 

Since {PgU) : e > 0} can be viewed as a subset of {tt G 7 r(s, si, S 2 ) = l,s G 

5}, which is compact under the Euclidean distance, one can hnd a sequence ei,e 2 , • • • converging to zero such 
that 


for some pg^ with E[-u;i(5', 5i)] < di, i = 1, 2. Now the proof can be completed via a simple limiting argument. 


B. Application to the Problem of Broadcasting Correlated Sources 

In view of (|6]l, one can readily deduce from Theorem |5] the following outer bound on the admissible source 
region. 

Theorem 6: If P(Si,S 2 ) admissible for broadcast channel Pyi,Y 2 \x subject to bandwidth expansion constraint 
K, then 

C{PiSi,S2)) ^ l<d^{PYi,Y2\x)- ( 10 ) 

The following result provides a complete characterization of the source admissible region and a rigorous justih- 
cation of the source-message correspondence in the case where iSi gg Sq gg S 2 form a Markov chain. 

Corollary 3: A source distribution P[Si,S 2 ) with S'! gg S'o S 2 forming a Markov chain is admissible for 
broadcast channel Py^,Y 2 \x subject to bandwidth expansion constraint k if and only if 

(H{So),H{Si\So),H{S2\So)) G kC{py„y2 \x)- (H) 

Proof: The proof of the “if’ part is based on a simple separation-based scheme. The transmitter hrst compresses 
S'™ via entropy coding and maps the resulting bits to the common message Mq; given S™, the transmitter further 
compresses S™ via conditional entropy coding and maps the resulting bits to the private message Nf, i = 1 , 2 . 
Note that (fTTI) ensures the existence of a good broadcast channel code such that receiver i can recover (Mq, Mi) 
and consequently S™ with high probability, j = 1 , 2 . 

The “only if’ part follows from Theorem|6]as well as the fact that ( 7 T(So), iT(Si|So), iT(S2|So)) G C(P(Si,S 2 )) 
when Si GG So GG S 2 form a Markov chain. ■ 

In view of Theorem 0] and Corollary[3 the necessary conditions in Theorem|3]and Theorem|6]are equivalent to (O 
and (fTTI) . respectively, when Si GG So GG S 2 form a Markov chain. It is known ll22l that in general CoutfPFi.YblJt) 
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can be strictly larger than C{pyi,y 2 \x)- So it is possible to find an example for which 

{H{So),H{S,\So),H{S2\So)) i nC{pY,,Y2\x), 

{H{Sq),H{Si\Sq),H{S2\Sq)) e KCout(pyi,Y2|x)- 

This meanthat Theorem |6] cannot be deduced from Theorem [3 
Note that both (|7]i and (fTol i imply 

C{p(s^,S2)) ^ I‘^Cou\{pyi,Y2\x)- ( 12 ) 

We shall show that (fTSl l suffices to recover several existing results. Let Cd{pyi,Y 2 \x) denote the capacity region of 
broadcast channel Pyi,Y 2 \x with degraded message sets, i.e., 

Cd{PYi,Y2\x) = {{Roi R 2 ) ■ iRo,0,R2) € C{pY:^,Y2\x)}- 
It is known ll23l that Cd{pyi,y 2 \x) is given by the set of {Rq,R 2 ) € satisfying 

Ro<I{V;Yi), 

R2<I{X;Y2\V), 

Ro + R2 < I{X;Y2) 

for some pv,x,Yi,Y 2 = Pv\xPxPyi,Y 2 \x with |V| < \X\ + 1. Moreover, it can be verihed that 

{{Ro,R2 ) : (i?o,0,i?2) £ CoutiPYi,Y2\x)} = Cd{pyx,Y2\x)- (13) 

The following result is a special case of Il24l Theorems 2 and 3]. 

Corollary 4: A source distribution P(Si,S 2 ) with being a deterministic function of S 2 is admissible for 
broadcast channel Pyi,Y 2 \x subject to bandwidth expansion constraint k if and only if 

H{S2 \Si)) & kCd{pyi,Y2\x)- (14) 

Proof: The proof of the “if’ part is based on a simple separation-based scheme. The transmitter first compresses 
S'™ via entropy coding and maps the resulting bits to the common message Mq; given S™, the transmitter further 
compresses S™ via conditional entropy coding and maps the resulting bits to the private message M 2 . Note that 
Ell ensures the existence of a good broadcast channel code such that receiver 1 can recover Mg and consequently 
S™ with high probability while receiver 2 can recover (Mg, M 2 ) and consequently S™ with high probability. 

The “only if’ part follows by (fT3) and (fOl) as well as the fact that (iT(Si), 0, iT(S 2 |Si)) £ C{p(Si,S 2 )) when 
Si is a deterministic function of S 2 . ■ 

We say Py 2 \x is more capable than Pyi\x if I{X;Y 2 ) > I{X;Yi) for all px ll25l ll^ p. 121]. It can be verified 
that 

{(0,i?i,i?2) £ Cout(pyi,y2 |x)} = Co{py^,Y2\x) (15) 


^We believe that Theorem |3 also cannot be deduced from Theorem [6] 
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when Py 2 \x is niore capable than Pyi\x- 

The following result ||6l Theorem 4] is a dual version of Corollary |4] 

Corollary 5: A source distribution is admissible for broadcast channel(withpY 2 |x more capable 

than py^\x) subject to bandwidth expansion constraint k if and only if (O holds. 

Proof: The proof of the “if’ part is the same as that for Corollary |4] The “only if’ part follows by (fT^ and 
(flSl l as well as the fact that (0,if(S'i),if(S' 2 |S'i)) £ C{p(^Si,S 2 ))- ■ 

VI. Conclusion 

We have established two necessary conditions for the lossy source broadcast problem (Theorem [T] and Theorem 
|5ll, from which new outer bounds on the admissible source region (Theorem [3] and Theorem |6]l are deduced. It is 
expected that the idea of deriving converse results via suitable comparisons between the virtual channel (induced 
by the source(s) and the reconstruction(s)) and the physical channel has potential applications beyond the lossy 
source broadcast problem considered in the present paper. 


Appendix A 
Proof of Lemma[T] 

Let 5™) be jointly distributed with S'™ according to 

2 


(16) 


where 


psm{s"^) = 


pm 


Pvr = Y[{yi{q),y 2 {q)\x{q)). 

n 

Note that the induced conditional distribution'^ 1® degraded with respect to in f^ct, 

every 5 m|gm degraded with respect to Py^^,Y f^\XP^ 6e obtained in this way. 

Let (Ulf,--- ,C^r) be jointly distributed with (S™, Y'/’™, F/™, Sf, S^) such that (C/g™, • • • ,Uff) 

S™ O {XP^, Y/’™, Y/™, Sj", S^) form a Markov chain, and {Uo(t), ■■■ , UlII), S(t)), f = 1, • • • , m, are inde¬ 
pendent and identically distributed. Let T be a random variable independent of (C/™i, • • • , C/™, S™, S™, S™) and 
uniformly distributed over {1, • • • ,rn}. Define 


Ui = UdT), i = 0,-- 

S = S{T), 

s, = s,(r), i = i, 2 . 


,L, 


ps(s) > 0 for all s S <S, then p^m is uniquely given by (4). If ps(s) = 0 for some s S <S, then the conditional distribution in 

0 is not the only one that is compatible with the joint distribution in 116L in this case we simply use 0 as the definition of pgm gm^gm- 
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The following properties of (C/q, • • • ,Ul, S, Si, § 2 ) can be easily verified; 

1 ) the distribution of {Uo, ■ ■ ■ , Ul, S) is identical with that of (Uo{t), Ui{t), U 2 {t), S{t)) for every f; 

2 ) {Uo, ■ ■ ■ ,Ul) S { 81 , 82 ) form a Markov chain; 

3) is the single-letterized versiorl^ of pg„ 

Note that 




2=1 


k m 


i=i t=i ^ 

k m 

= T.T,iiuMty. 4”.,. . f'i; 

i=l t=l ■* 

k m 

^ E E W’w) 

2=1i=l ' 

k 

= mY, I (UA. {T); (T) | (T) , T) 

2=1 

k 

= mYHUA.{n Sai^){T),T\U^,-j^Y^)) 

2=1 ^ 
k 

> mYHUA.{n Sai^){T)\U^.-j^Y'^)) 


2=1 

fc 


— ™ E! ^O^Ai ; ‘^a(j) )■ 


i=l 


On the other hand, we have 


J—L J _ J—i J 

2=1 2=1 


We shall show that, for I = 1, ■ ■ ■ ,k, 

'tr(uz;Ysr,p:j-.^_) 


i—l 


fJTTt /v f 

< E ^(Er+i; > E”') + E E > E”', E^+i)- 

T J —1 ^ -71 ^ 

q —1 i—l q —1 

which, in light of Csiszar sum identity ll26l p. 25], is equivalent to 

jlnnA':S)K‘r\A,) 

i=i " 

pm k pm 

< Y HYr\Y2{q)\uYi ^^, Er+i)+E E xux ; {q)\uYiA, - Er+i)- 

^—1 ^ „•_? ^—1 


fc pm 


(17) 


(18) 


9=1 


(19) 


^'strictly speaking, S 2 \S^''’ uniquely specified only for those s G {s^ G *5 : psi^') > 0}. However, this suffices for our purpose 

since the results in the present paper depend on p^^ 521*5 through PsPg^ 52 |S' 
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First consider the case ^ = A:. If a{k) = 1, we have 

j — -1- J 

pm 


9=1 

pm 


< ^ /(c/x, FC+i; ^ 1 ( 9 ) 


9=1 
pm 

9=1 ^ ' ■’ 

if a{k) = 2, we have 


9=1 




pm 


q^l 

pm 

< ^/(c/x,rr\y2(g)|c/™._,_^^,y^T+i) 


9=1 

pm 


pm 


= ^/(yr\y2(<7)|c/5^-i^.>^2T+i) + E^(^X;^2(g)|c/5-l^.F^^r£Xl)• 

g=l ^ g=l ^ 

Therefore, (fTSl) and ( fT^ hold when I = fc. Now we proceed by induction on 1. If a{l) = 1, we have 

i—l 

= /(c/X;Frit/^,_.^p+ E 

pm 

< /(c/X;i"rit^X-^.) + E^(^ 2 T+i;^i( 9 )lt^X 

’ ,=i ' 

fe pm 

+ E E^(t^X;^aw(g)|c/X-i^.>^E,iXr+i) 

pm pm 

= ^ /(C/X; ri(q)|C/X-.^^, vr^) + ^ , vr^) 

q^l " ' P-1 

k pm 

i^i+i p-i ^ 

pm k pm 


9=1 

pm 


i—l^lq—1 
k pm 


( 20 ) 


= E nY,7+i^Y,{q)\u;).. ,rr^) + J2J2 ^(^X;>^aw ,Yr\Y{-,), 

q—1 t—l q—1 

where (l2Q] t follows by the induction hypothesis. Therefore, (fTSi t holds when a{l) = 1. Similarly, it can be shown 
that ([T9] t holds when a{l) = 2. This finishes the induction argument. 
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Let Q be a random variable independent of , C/™, X'’™, F/’™, 1^2^™) and uniformly distributed over 

{1, • • • , pm]. Define 

L, = (t/r, z = 0, • • • , L, 

X = X{Q), 

F=F(Q), i = l,2. 


It is clear that (Vb, • • • , Vl) O X o (Yi, F 2 ) form a Markov chain; moreover, px does not depend on the choice 
of Puo,— ,Ul\S- Continuing from (fTTl) . 

i—1 

pm k pm 


q^l 


i—2 q—1 


< 


k 

pmliUZ , Y^-\ F,(i)(Q)IQ) + pm WZ ; Ya^i) (Q)I Y^^^^, Q) 

i=2 ■* 

k 

pmliUZ , Y^-\ Q; F„(i)(Q)) + pm ^ I{UJ ^; F,(,)(Q)I11:q+i, Q) 


2=2 


pm ^ ^ -^(Cyti I ^(i) )’ 

i=l 

where (12111 is due to ( flSl l and ( fT9l l as well as the fact that 


pm 


pm 


E ^(^2^+1; (9) ) + E ; ^a(i) (?) xr' > ^2 T+i) 


9=1 


9=1 


put 

= E W”^^X9)X27+i) + Exc^X;^a(i)(g)|rr\r27+i) 


9=1 

pm 


9=1 


< Exc/X-X’”'>^27+i;^-(i)(9))- 


9=1 


This completes the proof of Theorem [T] 


Appendix B 
Proof of Theorem[T] 


According to Lemma [T] for every virtual broadcast channel pg^ realizable through the physical broadcast 
channel Pyi,Y 2 \x with bandwidth expansion ratio p, there exists an input distribution px such that, for any 

Puo,-,U l,s,SiA = PUo,- ,Ul\sPsPs^,s- 2 \s^ PVo,- = PVo, - ,Vl\xPxPYi,Y 2 \x satisfying 


; 5a(^) It/utiAi )^ p 11 XiCt.; ib.wlKi.-x) 




( 22 ) 
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for any Ai C {0, • • • ,L} and a{i) G {1, 2}, i = 1, • • • , fc. Now choose L = 2. Setting k = 1, Ax = {0}, and 
a(l) = 1 in (|22]) gives 

nUo-,Sx)<pI{Vo-,Yx). (23) 

Setting k = \, Ax = {0}, and a(l) = 2 in (l22li gives 

I{Uo;S2)<pI{Vo;Y2). (24) 

Setting k = 1, Ax = {0,1} and a(l) = 1 in (l22l l gives 

/(C/o, Ux\Sx) < pI{Vo, Vx;Yx). (25) 

Setting k = 1, Ax = {0, 2}, and a(l) = 2 in (l22l i gives 

/(C/o, C/ 2 ; ^ 2 ) < pKVo, V2; Y2). (26) 

Setting k = 2, Ax = {0}, A2 = {2}, a(l) = 1, and a(2) = 2 in (|22| gives 

I(Uo;Sx)+I(U2;S2lUo) <p[I(Vo;Yx) + I(V2;Y2lVo)]. (27) 

Setting k = 2, Ax = {0}, A2 = {!}, a(l) = 2, and a(2) = 1 in (|2^ gives 

/(C/o;^ 2 )+/(C/i;^i|C/o) <p[/(yo;l" 2 ) + /(l/i;>l|l/o)]. (28) 

Setting A: = 2, yfi = {0,1}, A 2 = {2}, a(l) = 1, and a(2) = 2 in (l22l) gives 

/(C/o,C/i;,§i)+J(C/ 2 ;^ 2 |C/o,C/i) <p[/(l/o,Vi;yi) + /(F 2 ;l" 2 |Vb,'l/i)]. (29) 

Setting A: = 2, ^1 = {0, 2}, ^2 = {!}, a(l) = 2, and a(2) = 1 in (l22l) gives 

/(C/o,C/ 2 ;^ 2 ) + /(C/i;^i|C/o,C/ 2 ) <p[/(1/o,V2;F2) + /Ct^i;n|K),'t^ 2 )]. (30) 

Setting A: = 3, = {0}, .42 = {2}, .43 = {!}, a(l) = a( 3 ) = 1, and a( 2 ) = 2 in gives 

/(C/o; ^ 1 ) + /(C/ 2 ; ^ 2 |C/o) + /(C/i; 5i|C/o, C/ 2 ) < p[/(yo; n) + HV 2 ; Y 2 \Vxx) + /(4i; FilK), ’^^ 2 )]. (31) 

Setting A: = 3, 4li = {0}, A 2 = {1}, 4 I 3 = {2}, a(l) = a(3) = 2, and a(2) = 1 in gives 

/(C/o; ^ 2 ) + /(C/i; ^i|C/o) + /(C/ 2 ; 52|C/o, C/i) < p[I{Vxx-, > 2 ) + /(f4; 14|K)) + /(I/ 2 ; > 2 !^), (32) 


May 6, 2015 


DRAFT 


20 


Let TZ{ps,Pg^ Sals) denote the set of (ri, • • • ,rio) € K+ satisfying 

n < I{Uo]Si), 
f2 < I{Uo; S 2 ), 

I'd. < liUo.Ui, Si), 

fA < I{Ud, U 2 ', S 2 ), 

rs < I{Uo;Si) + I{U 2 ', S2\Uo), 

re < I{Uo;S2) + I{Ui; Si\Uo), 

ri < I{Uo, C/i; Si) + /(5; S2\Uo, Ui), 

rs </(C/o, C/2; ^2) +/( 5 ; ^i|C/o, t/2), 

rg < I{Uo;Si) + I{U 2 ', S2\Uo) + I{S-, Si\Uo,U2), 
no < /(C/o; 52 ) + I{Ui; Si\Uo) + /(5; S 2 \Uo,Ui) 

for some Puo,Ui,U2,S,Si,S2 = PUo,Ui,U2\sPsPs,,S2\S’ analogously, let n{px,PYuY2\x) denote the set of (ri, • • • , rio) S 
satisfying 

ri<IiVo-,Yi), 

r2<I{Vo;Y2), 

rz<I{Vo,Vi-Yi), 

rA<I{Vo,V2-,Y2), 

n<I{Vo-,Yi) + I{V2-,Y2\Vo), 

ro<I{Vo-,Y2) + I[Vi-Yi\Vo), 

ri < I{Vo,Vi-Yi) + I{X-Y2 \Vo,Vi), 

n<I{Vo,V2-,Y2)+I{X-Yi\Vo,V2), 

r9<I{Vo-,Yi) + I{V2-,Y2\Vo) + I{X-Yi\Vo,V2), 

no < HVo-,Y 2 ) + I{Vi;Yi\Vo) + IiX-,Y 2 \Vo, Vi) 

for some PVo,VuV2,x,Yi,Y2 = PVo,Vi,V2\xPxPYi,Y2\x- It can be shown (see Remark 3 . 6 ]) that (| 23 ])-(l 32 | can be 
stated equivalently as 

'^{PS,Ps^^S 2 \s) ^ pT^{PX,PYuY 2 \x)- ( 33 ) 

Moreover, the following argument by Nair ifTSl indicates that, to compute TZ{ps,Pg_^ S2|s) P^iPx,P yi,Y2\x)^ it 
suffices to consider \Uo\ < | 5 | + 5 , |Vo| < \X\ + 5 , \Ui\ < | 5 |, and |Vi| < \X\, i = 1,2. We shall only give the 
proof for TZ{ps,Pg^ S2\s') since Ti-ipx,PY i,Y2\x) can be treated in the same way. The main idea is that it suffices 
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for Ui and U 2 to preserve the extreme points of Tl{ps,Pg_^ Sais^’ '■° '^he region. 

Note that every convex combination of the constraints in the definition of TZ{ps,Pg_^ S 2 |s) written in the 

form 

XiH{Si) + X2H{S2) + XaliS; Si) + XiI{S; S2) + X 5 H{Si\Uo) + X6H{S2\Uo) 

+ XrH{Si\Uo, Ui) + XsHiS2\Uo, U2) + XiiH{Si\Uii, U2) + Aioi/( 52 |C/o, C/i), 

which depends on Puo,Ui,U 2 ,S only through Puo,Ui,S Puo,U 2 ,S- First fix pug. For every Uq = uq, one can 
find Ps,Ui\Uoi-r\uo) with \Ui\ < |5| that preserves PsiUoi'M and X 7 H{Si\Uq = Uo,Ui) + XioH{S 2 \Uq = 
uo,Ui); similarly, one can find Ps,c/ 2 |c/o('>'l^o) with |if 2 | < |<5| that preserves Ps|f 7 o(-|uo) and XsH{S 2 \Uo = 
Uq, U 2 ) + A9iF(5i|17o = Uq, 1 / 2 ). We can get a consistent joint distribution PUo,Ui,U 2 ,S by setting puo,Ui,U 2 ,S = 
PUo,SPUi\Uo,sPU 2 \Uo,S- Finally, it suffices to have \Uo\ < |5| + 5 for preserving ps, H{Si\Uti), H{Si\Uo,Ui), and 
H{S,\Uii,U2),i = l,2. 

Let {di,d 2 ) be a distortion pair that is achievable under distortion measures wi and W 2 subject to bandwidth 
expansion constraint k. In view of Definition [1] and the discussion in Section |II] for every e > 0, there exists a 
virtual broadcast channel Pg(e) g («)|5 realizable through the physical broadcast channel Pyi,Y 2 \x with bandwidth 
expansion ratio p < k + e such that E[r(;i(S', < di + e, i = 1, 2. It follows by (l3At that, for such Pg(c) 5 (')| 5 > 

we have 


, 5 (.)|s) C {k + e)'JZ{pxM ,Py^,Y 2 \x) 

for some PxM- Since {(Pg(e) 5(0|g,Fjs:(^)) : e > 0} can be viewed as a subset of {(tTjTt') G ]gl^l^l‘ 5 i|xl‘ 52 | ^ |^l^l , 
SsieSi S 2 GS 2 ^ 2 ) = 1, s G <S, and = 1}, which is compact under the Euclidean distance, one 

can find a sequence ei, £ 2 , • • • converging to zero such that 


lim PoCefc) 
k —¥00 *^1 ’*^2 1 *^ 


FSi,S2|S> 


lim Px(.^k) = Px 

k—¥oc 

for some pg^ with E[wi(S', Si)] < di, i = 1,2, and px- Now a simple limiting argument yields 


'^(PS^PSkAls) ^ f^T^{PX,PY,,Y:2\x)- (34) 

Note that 7^(px,Pyi,Y'2|2s:) is a convex set. As a consequence, (1?^ holds if and only if k'R-{px,PYi,Y 2 \x) contains 
all extreme points of TZ{ps,Pg^ S 2 \S^' realize all such extreme points, it suffices to consider \Uo\ < |<S|. This 
completes the proof of Theorem [T] 


Appendix C 
Proof of Theorem|4] 

We shall only prove that (|8]l implies the necessary condition in Theorem |3] when S*! O O S 2 form a Markov 
chain since the other direction is straightforward. 
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Note that the necessary condition in Theorem |3] can be written equivalently as 

^(P(Si,S2)) ^ kTZ{px,Pyi,Y2\x) (35) 

for some px, where TZ{p(^Si,S 2 )) the set of (ri, • • • ,rio) G satisfying 

r-i </([/; 5i), 
r2<I{U-S2), 
ra < H{Si), 

r4 < H{S2), 

rs </([/; Si) + H{S2\U), 

re<I{U;S 2 )+H{Si\U), 

rr <I{U;Si)+H{SyS2\U), 

r8<HU;S2)+H{Si,S2\U), 

rQ<IiU;Si)+H{SYS2\U), 

rio<HU;S2)+H{SuS2\U) 

for some Pu,{ 81 , 82 ) = Pu\{ 8 i,S 2 )Pi 8 i, 82 ) with \U\ < |5| + 2, and n{px,PYi,Y 2 \x) is defined in Appendix E On 
the other hand, ([8]l can be written equivalently as 


{H{So),H{Sx\So),H{S2\So)) G nCout{px,PYi,Y2\x) 


(36) 


for some px- Therefore, it suffices to show that (l3^ implies dTSl l when O S'o o S 2 form a Markov chain. 
Throughout the proof we assume px is fixed. 

It is clear that both Ti.{p(^Si, 82 )) ^tid 'R-{pxtPyi,Y 2 \x) closed convex sets. Let Ai, • • ■ , Aio be arbitrary non¬ 
negative numbers. We have 


10 

max y XiTi 

{ri,---,rio)&Tl{P(Si,S2)) 

= max \iI{U;Si)+X2l{U-,S2)+X3H{Si) 

PuKSi.Sa) 


+ X4H{S2) + A5[/(C/; 5i) + H{S 2 \U)] 

+ Xe[IiU;S2)+H{S4\U)] 

+ Xr[I{U;Si)+H{SYS2\U)] 

+ Xs[I{U;S2)+H{SyS2\U)] 

+ Xg[IiU;Si)+H{SYS2\U)] 

+ Xio[IiU-,S2) + H{Si,S2\U)] (37) 
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— max (Ai + A 3 + A 5 + A 7 + Xg)II [Si) 

P(/|(Si,S2) 

+ (A 2 + A 4 + Ae + Ag + Aio)-ff(<5'2) 

— (Ai + A 5 — Xq + A 7 + Xg)H(Si\U) 

— (A 2 — A 5 + Ag + Ag + Xiq)H{S2 \U) 

+ (A 7 + Ag + Ag + Xio)H{Si, S 2 \U) 

= max (Ai + A 3 + A 5 + A 7 + Xq)H[Si) 

PC/|(Si,S2) 

+ (A 2 + A 4 + Ag + Ag + Aio)i?(>S' 2 ) 

-(Ai + A2)i?(5'o|C/) 

— (Ai + A 5 — Ag + A 7 + Ag)-ff(S'i|S'o,C/) 

— (A 2 - As + Ag + Ag + Xio)H{S2\So, U) 

+ (A 7 + Ag + Ag + Xio)H{Si, S' 2 |<S'o, U) 

< max (Ai + Ag + As + A 7 + Xq)H{Si) 

P(/|(Si,S2) 

+ (A 2 + A 4 + Ag + Ag + Aio)-ff(5'2) 

-(Ai + A 2 )i?(S'o|t/) 

— (Ai + As - Ag - Ag - Xio)H{Si\So, U) 

— (A 2 — As + Ag — A 7 — Ag)-ff (S' 2 |S'o, U), (38) 

where the last inequality follows from the fact that 

H{Si,S2\Sii,U) < H{Si\Sii,U) + H{S2\Sii,U). (39) 

Let a = Ai + As — Ag — Ag — Aio and & = Ag — As + Ag — A 7 — Ag. Consider the following four possible cases. 

1) a < 0 and & < 0; The maximum value of (l38l l is attained when U = Sq. 

2) a> 0 and & < 0; The maximum value of ( l38l l is attained when U = Si. 

3) a < 0 and & > 0: The maximum value of ( l38l l is attained when U = Sg. 

4) a > 0 and b > 0; The maximum value of (I381 l is attained when U = {Si, S'g). 

It is clear that the equality holds in (|39] | for the following four choices of U: 

1) U = So, 

2) U = Si, 

3) U = S2, 

4) U={Si,S2). 

Therefore, the maximum value of (ITtT i is also attained by one of these four choices of 17; as a consequence, for 
the necessary condition in Theorem [3 there is no loss of generality in restricting U to such choices. Note that (|36] | 
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can be expressed alternatively as 

HiSo) < KUim{I{Vo*-,Yi),IiVo*;Y2)}, (40) 

H{Si) < K[mm{IiV*-,Y^),I{V*-,Y2)} + I{V:-,Y,\V*)], (41) 

H{S2) < K[mm{I{V*-,Yi),I{V*-,Y2)} + I{V^*-,Y2\V*)], (42) 

H{Si,S2) < K[mm{I{V*;Y,)J{V*;Y2)} + I{V*;Y,\Von+I{X-,Y2\V*,V*)], (43) 

H{Si,S2) < K[mm{I{V,*;Y,)J{Vo*;Y2)} + I{V,*-,Y2\V,*)+I{X-,Y,\Vo*,V,*)] (44) 

for some pv‘,v‘,v‘, x,Yi,Y 2 = Pv*,v*, v*\xPxPYi,Y2\x- Setting U = 5*0 in Theorem | 3 ] yields the same set of 
constraints. On the other hand, when U = Si, the necessary condition in Theorem | 3 ] can be written as 

H{So)<KnVo;Y 2 ), (45) 

HiSi)<KliVo-,Yi), (46) 

H{S2) < kI{Vo,V2-,Y2), (47) 

H{S2)<ti[I{Vii-Y2) + I{Vi-,Yi\Vo)+I{X-Y2\Vii,Vi)], (48) 

H{Si,S2) < k[I{Vo-,Yi) + I{V2-,Y2\Vii)\, (49) 

H{Si,S2) < k[I{Vii,Vi-Yi) + I{X-Y2\Vii,Vi)\ (50) 

for some PVo,VuV2,x,Yi,Y2 = PVo,Vi,V2\xPxPyi,Y2\x- By choosing Vq = Vi = {Vq,Vi) and V2 = X, we can 

see that (|4ii^(|45]l, (|4T]i=:>(|46ll, (|42li=>(|47li, (gUi^dli, (|43]l^(|49]l, and (|43]l^(l50|. The case U = S2 follows by 
symmetry. When U = {Si,S 2 ), the necessary condition in Theorem [3] can be written as 

HiSi) <KliVo-,Yi), (51) 

H{S2)<kI{Vo-Y2), (52) 


for some pvo,x,Yi,Y 2 = PVo\xPxPyi,Y 2 \x- By choosing Vb = we can see that (HTt^dSTTi and (I42li^(l52]i. Hence, 
(iTSb is indeed implied by (l36l l when S*! O S'o O S 2 form a Markov chain. This completes the proof of Theorem 

El 


Appendix D 
Proof of Lemma|2] 

Let (5™, S^) be jointly distributed with S'™ according to 

where ps'"(s™) = Ot^iP‘S'('®(0)- We assume that pgm 5 m|gm is degraded with respect to Py{"^,y,^’^\x^’ where 

= U.q=lPY^,Y 2 \xiyliq),y 2 iq)\xiq)). As a consequence, 

pCiPsY^^s^lsm) C = pmC{pY^^Y2\x)- (53) 


May 6, 2015 


DRAFT 


25 


Let C\n{ps"^,Pgm 5 m|gm) denotc the set of (i?o, f?i, f? 2 ) G K+ satisfying 
i?o < mm{/(C/o™;^r), 

+ < w,c/r;5r), * = 1,2, 

i ?0 + + i ?2 < min{/([/o”^; ^r), ^(^ 0 ™; 4™)} + ^r|llo”^) + mT'. S^\U^) - /(C/r; C/r ILo"^) 

for some (C/g™, C/{", C/ 2 ™) be jointly distributed with (S'™, Sj", S^) such that (C/g™, C/f, C/ 2 ™) O S™ O (Sj”, S^) 
form a Markov chain, and {Uo{t), Ui{t), U 2 {t), S{t)), t = 1, - ■ ■ , m, are independent and identically distributed. It 
is clear that 

Cin(ps™,/'5m_5J‘|S’”) — ^iniPS”' ,Psp^S^\S”'^ — ^(Psp,S^\S”')- 

Let T be a random variable independent of (C/™i, C/™i, C/™]^, S™, S™]^, S™^) and uniformly distributed over {1, • • • , m}. 
Define 

U, = UiiT), i = 0,1,2, 

S = SiT), 

S, = S,{T), i = l,2. 

Note that 

m 

/(C/o™;S™) = ^/(C/o(f);S™|C/‘-i) 

m 

= Y,i{Uo{ty,sr,ul^) 

m 

>^/(C/o(f);S.(C)) 

= m/(c/o(r);S,(r)|r) 

= m/(C/o(r);S,(r),T) 

>m/(C/o(r);S,(r)) 

= mI(Uo;Si), 2 = 1,2; 

moreover, 

m 

I{ur; S™|C/o™) = ^ /(C/.(/); S™|C/o™, C/^l), 

m 

= ^ /(C/.(/); S™, C/^\ C/o™,+i, C/^l|C/o(^)) 

m 

>Y,Hu^{t)■,syt)\Uoit)) 

= m/(C/,(T);S,(T)|C/o(T),T) 
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= mI{U,{T)-S,{T),T\Uo{T)) 
>mI{U,{T)-S,{T)\Uo{T)) 


= mI{Uv,S,\U^), i = l,2, 


and 


/([/r; = m/(C7i; U 2 \Uo). 


Therefore, we have 


^ jPgm (55) 

Combining ( l5Tt . ( |54] |. and (l55l l completes the proof of Lemma |2] 
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